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Abstract. It is well-known that well-posedness of a martingale problem in the class 
of continuous (or r.c.1.1.) solutions enables one to construct the associated transition 
probability functions. We extend this result to the case when the martingale problem is 
well-posed in the class of solutions which are continuous in probability. This extension 
is used to improve on a criterion for a probability measure to be invariant for the semi- 
group associated with the Markov process. We also give examples of martingale prob- 
lems that are well-posed in the class of solutions which are continuous in probability 
but for which no r.c.1.1. solution exists. 
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1. Introduction 

The seminal paper on multi-dimensional diffusions by Stroock and Varadhan 1 12 1 intro- 
duced martinagle problems as a way of construction and study of Markov processes. Since 
then, this approach has been used successfully in several contexts such as interacting 
particle systems, Markov processes associated with Boltzmann equation, nonlinear filter- 
ing theory, controlled Markov processes, branching processes etc. A good account of the 
'theory of martingale problems' is given in the book by Ethier and Kurtz 1 7 1 . To construct 
a Markov process, the martingale problem approach allows one to construct the process 
for each initial condition separately and a general result gives the measurability of the 
associated transition probability function. To proceed, we give the basic definitions here. 

Given an operator A with domain 3>(A) C Cj,{E) and range subset of Cy(E) (where E 
is a complete separable metric space), a process Xf adapted to a filtration (J^,) is said to 
be a solution to the (A, 8 X ) martingale problem if for all / £ 2#{A), 



The martingale problem for A is said to be well-posed in the class of r.c.1.1. solutions 
if for all x there exists a r.c.1.1. process (Xf) satisfying and ( II. 21 and further for 
two such processes satisfying ( 11.11 and il .2[ (defined possibly on different probability 




(1.1) 



and 



(1.2) 
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spaces), the finite dimensional distributions are the same. Well-posedness in the class of 
continuous solutions or measurable solutions is similarly defined. A well-known result, 
which has its origins in the work of Stroock and Varadhan 1 13 1 says that if the martingale 
problem for A is well-posed in the class of r.c.1.1. solutions (or well-posed in the class 
of continuous solutions), then (assuming that A, 2)(A) satisfy some mild conditions) it 
follows that pt(x, •) defined by 

Pl (x,A)=F(XfeA) (1.3) 

is a transition probability function and any solution is a Markov process with p t as its 
transition probability function (see e.g. Theorems IV.4.2 and IV.4.6 of (7)). This in turn 
gives us the associated semi-group (T t ) and its generator L. The generator L happens to 
be an extension of the operator A and thus A contains all the 'relevant information' about 
L as well as about X. 

We extend this result and show that if the martingale problem is well-posed in the class 
of solutions that are continuous in probability, then (under suitable conditions on A, 2#(A)) 
the function p t defined by (II .31 is measurable. 

In order to achieve our aim we give a Borel structure to the set of distributions of 
processes that are continuous in probability. Once we have done this, we can deduce 
that well-posedness in the class of solutions which are continuous in probability implies 
measurability of the associated transition probability function. 

In §4, we give criterion for a measure to be invariant for the semigroup generated 
by a well-posed martingale problem. This is an improvement on several results on this 
theme (see 111 1213 14I6I91 101 ). In the last section, we give examples of operators (and their 
domains) satisfying the conditions of §3, and such that the corresponding martingale prob- 
lems are well-posed in the class of solutions that are continuous in probability but for 
which no r.c.1.1. solution exists. 



2. Preliminaries 

We will denote by (E,d) a complete, separable metric space. A will denote an operator 
with domain D(A) C Cb(E), the space of real-valued bounded continuous functions on E 
and with range contained in M(E), the class of all real-valued Borel measurable functions 
on E. LetB(E) denote the class of all bounded Borel measurable functions. For C C B(E), 
we define the bp-closure of C to be the smallest subset of B(E) containing C which is 
closed under bounded pointwise convergence of sequences of functions. S§(E) will denote 
the Borel <7-field on E, &(E) will denote the space of probability measures on E. For a 
random variable Z taking values in E, J2?(Z) will denote the law of Z- i.e. the probability 
measure PoZ -1 , if Z is defined on (£2, J?",P). For a measurable Process(X f ) defined on 
(Q,^",P),let 

*&f = a |x„, J" h(X s )ds: u<t , he C b (E)\ . 

Throughout this article, we will assume the following: 
Assumption Al . There exists a [0,°°) -valued measurable function <t> on E such that 



\Af(x)\<C f <P(x) Vxe£,/G^(A). 



(2.1) 
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DEFINITION 2.1. 



An E -valued process (X t )o<t<o° defined on some probability space (£1, J?,P) is said to be 
a solution to the martingale problem for (A, jj.) if 

(i) X is a measurable process with J?(Xq) = fi, 



(ii) E P 



Jo *(*vM* 



< °o for all T < °°, and 



(iii) for every / e £^(A), 

M/ = f(X t ) - [' Af(X s ) ds 
Jo 



(2.2) 



is a (* J^)-martingale. X will be called a solution to the A martingale problem if it 
is a solution to the (A,/i) martingale problem for some /x. 



Let W be a class of ^-valued processes. For example, we could consider W to be the 
class of E-valued processes with r.c.1.1. paths or W can be the class of solutions that are 
continuous in probability. 

DEFINITION 2.2. 

The martingale problem for A is said to be well -posed in the class W if for all x E E, there 
exists a solution X x E W to the (A, 8 X ) martingale problem and if Y E W is any other 
solution to the (A,8 X ) martingale problem, then the finite dimensional distributions of X x 
and Y are the same. 

We begin with some observations on solutions to the A-martingale problem. 

Theorem 2.1. Let X (defined on some J?,P)) be a solution of the martingale problem 
for A. Suppose that Si (A) is a determining class and further that 

t — > J£(X t ) is continuous. (2.3) 

Then t — > X t is continuous in probability. 

Proof. Let / G S(A). The assumption d2.3l > alongwith the fact that the martingale (see 
eq. \2.2Y ) has a r.c.1.1. modification implies that is continuous in probability. This in 
turn implies that the mapping t — > f{Xt) is continuous in probability. As a consequence, 

for f,ge 9(A), 

(s,t) — > E r [f(X s )g(X t )] is continuous. (2.4) 

Let Sk — ► 5. The assumption d2.3l > implies that the family of distributions {_Sf (X s , )} is tight 
and so the family of distributions (on E x E) 

{&(X Sk ,X s ):k> 1} is tight. (2.5) 

Since the class of functions — ► f( x )g(y)> f,g € ^(A) constitutes a determining 
class, ( 12. 4t and d2.5l > together imply that 



(2.6) 
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Now for any e > 0, ¥(d(X s ,X s ) > e) = 0. Thus in view of fTB> 
limmpV(d(X Sk ,X s ) > e) < 

i.e., 

P{d{X Sk ,X s )>e)^0. 

This completes the proof. ■ 

Remark 2.2. The proof given above contains the proof of the following: if for a process 
Y, the mapping (s,t) — ► _S? (Y s ,Y t ) is continuous, then Y is continuous in probability. 

Remark 2.3. The assumption j2.3t can be replaced by 

{X t : < t < T} is tight W < °°. 

COROLLARY 2.4. 

LetX (defined on some (Q., j^P)) foe a solution of the martingale problem for A. Suppose 
that the domain S>{A) of A is a convergence determining class on E. Then the process X 
is continuous in probability. 

Proof. Since f(X t ) — f t (j Af(X s )As is a martingale for / E 3>{A), it follows that the map- 
ping t — > Ep[/(Xf)] is continuous. Since 3>{A) is a convergence determining class, this 
implies continuity of the mapping 

t — 

Thus, by Theorem l2.ll t — ► X t is continuous in probability. ■ 
3. Main result 

We have seen in the previous section that under suitable conditions, all solutions to a 
martingale problem are continous in probability. Thus we now construct a Borel structure 
on the class of distributions of such processes. 

For m > 1, E m with the product topology is again a complete separable met- 
ric space. Let &(E m ) be equipped with the topology of weak convergence. Let 
%„ = C([0,°°) m , & (E m )) be equipped with the topology of uniform convergence on 
compact subsets. Then ^ m is a complete separable metric space. Let S^ m be the set of 
\l m = H m (h,t 2 , ...,t m )e'# m satisfying 

J(nf)(xi,x 2 , ■ ■ ■ ,x m )n m {t % \,t % 2, . . . ,t„ m ){dxi,dx2, ■ ■ ■ ,dx m ) 

= J f[xi,X2,---,x m )^ m (h,t2,...,t m )(6xi,dx2,...,dx m ) (3.1) 
for all permutations n of {1,2, . . . ,m}, for all / G Ct,(E m ) where nf is defined by 

ftf{ x lT X 2: ■ ■ ■ , x m) — f( x 7il: x K2i ■ ■ ■ T X 7tm)- 
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It is easy to see that 5^ m is a closed subset of % v and hence S? m is a complete separable 
metric space. Let = n™ =1 oSV Under the product topology, J?oo is also a complete 
separable metric space. Elements of S?™ will be denoted by \i = (jj, 1 ,ji 2 , . . . ) with ji k E 
S^k - Let D denote the diagonal in E 2 , 

D = {(x,x): x E E} 

and let 

Jtf = {ju 2 g y 2 : ii 2 {t,t){D) = 1 Vr e [0,°o)}. 

Since D is closed in E 2 and ji 2 G ^"2 is continuous, it follows that ^f 7 is a closed subset 
of y 2 - Let 

^* = {M G ^L: M m (t 1 , ■ ■ ■ , t m ) o (h m ) - 1 = At"- 1 (f 1 , . . . , t m - 1 ) , Vm > 1 } , 
where h m : E m — ► E m ~ l is the projection map defined by 

^mC*-l )-^2> ■ ■ • j-^m) — (^1 >-^2> ■ ■ ■ i%m— l)* 

Let 

= {/i G J^*: ;lt 2 G JT}. 

Then clearly J?" is also a complete separable metric space since it is a closed subspace 
of c5^oo. Every element of ^ is a consistent family of finite dimensional distributions and 
hence by the Kolmogorov consistency theorem, given ji = (jj, 1 ,/x 2 , . . . ) G J?*, there exists 
a probability space (fi* , , P* ) and a stochastic process (X; ) on it such that for all m > 1 , 

-SfpQi • • i^Q m ) = tJ- m (h,h, ■ ■ ■ ,t m ). (3.2) 



In view of Remark l2~2l and the fact that jj, 2 G Jf?, the process X is continuous in probabil- 
ity. Conversely, given a E-valued process X that is continuous in probability, jj.'" defined 
by J3.2i belongs to ,5^ m , jj, 2 belongs to Jt° and clearly {jj. 1 ,/j, 2 , . . . } is a consistent family 
and hence jx — (jj, 1 ,/J, 2 , ...) G J/. Thus, can be identified with the class of distributions 
of £-valued processes that are continuous in probability. 

Having given a topological structure to the class of (distributions of) processes that are 
continuous in probability, we now identify the class of (distributions of) solutions to the 
martingale problem for A and show that it is a Borel set. As in the corresponding result 
on solutions with r.c.1.1. paths [7 1, we assume that A, 2l(A) satisfy the following: 

Assumption A2. There exists a countable set {/„: n > 1} C 2>{A) such that 

bp - closure{ (/„ , <S> l Af n ): n > 1 } D {(/, *" 1 Af) : f G S>(A)}. 

Let X be a process that is continuous in probability (on some (fl, J^, P)). Since every such 
process admits a measurable modification |5 1, we assume that X is measurable. Let <S be 
a countable fop-dense subset of Cf,(E). Then X is a solution to the A martingale problem 
if and only if 



N 



<j)(X u )du 



< 00 VJV > 1 
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and 



gl (X n ) . ..g k (X H ) (f m {X t ) - f m (X s ) - J\Af m ){X u )Au 



= 



for all s\,S2, ■ ■ ■ ,Sk, s ,t rationals with s; < s < t, gi 6 ^, 1 < i < k, k > l,m> 1, where 
{ff j 1 > 1} are as in Assumption A2. Thus, a measurable process X is a solution to the 
A martingale problem if and only if its finite dimensional distributions [i = (fi 1 ,/i 2 , . . . ) 
defined by 13.21 belong to M C & defined as follows: ^# is the set of ji — (ju 1 , /i 2 , . . . ) £ 
J?" satisfying 

2V 

{H l {s),<5>)ds<°° \JN>\ (3.3) 

(here, (F, r) denotes j FdF) and 

(fi k+l (s u S2,---,s k ,t),G(E)f m )-(n k+l (s u S2,...,s k ,s),G(E)f m ) 

= J (n k+l (s u s 2 , ■ ■ ■ ,s k ,u),G®Af m )du (3.4) 

for all s\,S2, ■ ■ -Sk,s,t rationals with si < s < t, gi S *S , 1 < i < k, k > l,m > 1, where 
{/,•: j > 1} are as in Assumption A2 and 

G<& f m (x u x 2 , ■ ■ ■ ,x k ,z) = g l (x i )g 2 (x 2 ) ■ ■ -gkixkjfmiz). 

Since is defined via countably many conditions with each condition in turn involving 
measurable functions of jj, — (jj. 1 ,^ 2 , . . . ), it follows that J% is a Borel subset of 5? . 
Moreover, given \i — (jj. 1 , /x 2 , . . . ) £ jM, as noted above there exists a process X such that 
its finite dimensional distributions are those given by [I = (ji 1 ,ji 2 , . . .). Further, jx 2 s 
and Remark 2.2 implies that this process is continuous in probability and can be assumed 
to be measurable. It follows that X is a solution to the A martingale problem. We have 
thus proved the following. 

Theorem 3.1. Suppose that A,S>(A) satisfy Assumptions Al and A2. Then pi = 
(jU 1 , ji 2 , . . . ) £ ^# if and only if there exists a process X that is (i) continuous in proba- 
bility, (ii) the finite dimensional distributions ofX are given by jX — (ju 1 , jX 2 , ■ ■ ■ ) and (iii) 
X is a solution to the martingale problem for A. 

We are now ready to prove the measurability of p, when the martingale problem for A 
is well-posed. We introduce the following: 

Assumption A3. The martingale problem for (A, 8 X ) is well-posed in the class of solutions 
that are continuous in probability for each x £ E. 

Theorem 3.2. Suppose that A, S>{A) satisfy Al, A2 and A3. Let X x denote a solution that 
is continuous in probability to the (A, 8 X ) martingale problem. Let p t (x,B), t £ [0,°°), x £ 
E,B£ 38(E) be defined by 

Pt {x,B)=P{Xf £B). (3.5) 

Then for all t £ [0,°°), B £ 3§(E), x ► p t (x,B) is Borel measurable. 
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Proof. Note that F = {8 X : x 6 E} is a Borel measurable subset of @*{E) (indeed it is a 
closed subset) and the function 0(8 X ) — x is a Borel measurable function on it (again this 
is a continuous function). Let y/ r : — ► &*(E) for < t < °° be defined by 



The functions y/r are continuous and hence measurable. Let — (i//q) 1 (F). It follows 
that is a Borel subset of S?. Also, \P = o y/o is a measurable function from into 
F. 

In view of the Assumption A3, for a given ie£, ^# has exactly one element = 
(jU 1 ,^ 2 , ...) such that 



and hence the function *P is one-to-one. Hence by Kurtowski's theorem (see e.g. Corollary 
1.3.3 of 1 1 1 1) the function is bimeasurable, or it has a measurable inverse. Let us note that 
V P _1 (x) denotes the finite dimensional distributions of X x - the (unique in law) solution to 
(A,8 X ) martingale problem which is continuous in probability. The required conclusion 
follows by noting that 



Assumption A4. &{A) is convergence determining. 

Assumption A5. The (A, 8 X ) martingale problem is well-posed in the class of measurable 
processes for allx G E. 

Remark 3.3. Let us note that Assumptions A4 and A5 imply Assumption A3. This is 
because Assumption A4 implies that every solution to the A martingale problem is con- 
tinuous in probability. Thus the conclusion of the above theorem remains valid with the 
same proof if instead we assume that A, &(A) satisfy Al, A2 , A4 and A5. 

Remark 3.4. Assume that Assumptions Al, A2 and A3 are true. Denote by 



the finite dimensional distributions of the (unique in law) solution to the (A, 8 X ) martingale 
problem that is continuous in probability. We have seen in the proof above that 



Pt {x,B) = y t {V- 1 



(x))(B). 



x 



is Borel measurable and hence for all h,t2, ■ ■ ■ ,t m , m > 1 



x 



t m ) is Borel measurable. 



(3.6) 



The next step is to prove that {T,: t > 0} defined by 




(3.7) 



is a semigroup on the class of bounded Borel measurable functions / on E. For this, we 
need to consider the martingale problem with non-degenerate initial distributions. Note 



90 



Abhay G Bhatt, Rajeeva L Karandikar and B V Rao 



that well-posedness for degenerate initials in the class of all solutions may not imply well- 
posedness for all initials. To proceed further, let us introduce the following notation: 



Jo 



(3.8) 



Then in view of Remark l3~4l it follows that <t>^ is a [0,°°)-valued measurable function. 
The next lemma shows that the existence of solution to the martingale problem holds for 
a large class of initial distributions. 

Let be the set of all measures A G tP(E) such that 



(3.9) 



Lemma 3.5. Suppose that A, %) (A) satisfy Assumptions Al, A2 and A3. Let A £ 2?q. Then 
V = (v 1 , V 2 , . . . ) defined by 



(V m (fi,f 2 ,...,f m ),g) = / (^"'(t u t 2 



g)dX(x) 



(3.10) 



belongs to ^ with v'(0) = X. Hence there exists a solution to the martingale problem 
for (A, A) (whose finite dimensional distributions are {v m }). 

Proof. It is easy to see that {v m } satisfy i3.4\ since each {fi'"} satisfies the same. Fur- 
ther, condition ( 13. 9t on X alongwith the definition of <t>^, implies that v 1 satisfies J3.3I > 
and hence {v m } belongs to . Thus the corresponding process Y is a solution to the 
martingale problem for (A , X ) . ■ 

We need one more observation on martingale problems before we can state our result 
on (Tt) defined by ( 13. 71 . 

Lemma 3.6. Let a process X defined on (£2, j?,P) be a solution to the (A, A) martingale 
problem and let g be a [0,M]-valued measurable function on E (where M < °o) such that 
(X,g) = I. Let 7 be defined by dy/dX = g. Let Q be defined by 



dp =8{xo) - 

Then, considered as a process on (i2, jF, Q), X is a solution to the (A, 7) martingale 
problem. 

Proof. Since g is bounded it follows that 



/ <i>(X u )du 
Jo 



<ME P 



<*>(X u )du 



Moreover, since dQ /dP is g(Xq) measurable, it follows that f(X t ) — f Af(X„)du is a 
martingale on (Q.,^, Q ) (as it is a martingale on (£2, J^",P)). The result follows upon 
noting that Q o (Xq)' 1 =7. ■ 

In addition to Assumption A3, we need to assume the following in order to show that 
{T t } is a semigroup. 
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Assumption A6. There exists a sequence {h„: n > 1} of [0,°°)-valued Borel measurable 
functions on E such that for every A S 3?(E) satisfying 

{h n ,X)<oo V«>1, (3.11) 

any two solutions to the (A, A) martingale problem that are continuous in probability have 
the same finite-dimensional distributions. 

Thus, in order to verify that Assumption A6 holds in a given example, we can show 
that the uniqueness holds under finitely many (or even countably many) integrability con- 
dition^). We are now in a position to prove the semigroup property of (T t ). In the course 
of the proof, we also get, with little extra work, the result that every solution to the mar- 
tingale problem satisfies the Markov property. The Markov property can also be obtained 
by following arguments as in |3) . 

Theorem 3.7. Suppose that A,@(A) satisfy Assumptions Al, A2, A3 and Ad. 

(i) The martingale problem for (A, X) is well-posed in the class of solutions that are 
continuous in probability if and only ifX G Further, the finite-dimensional laws 
of the solution Y that is continuous in probability are given by (13.1 Oi l, 
(ii) Let X £E ^<j,. Let X be a solution to the (A, A) martingale problem (defined on some 
probability space (£2, J^",P)). Further, let X be continuous in probability. Then X is 
a Markov process and the associated semigroup {T t : t >0} is defined by d3.7t . 

Proof. 

(i) Let X £ 3?<&. We have seen in Lemma l3~5l that the (A, A) martingale problem admits 
a solution X whose finite-dimensional distributions are given by (13. 101 . Let X be 
defined on (£2, J£",P). This process X is continuous in probability. Let Y be another 
solution to the (A, A) martingale problem defined on (£2, jF,P) such that Y is contin- 
uous in probability. Define g on E by 

where C is a constant that is chosen so that (X,g) = 1. Define probability measures 
y, Q and Q by 

dy dQ dQ 

d£=* dp =* (Xo) and ^F = ^)- 

By LemmaESl X on (£2,<F, Q ) and Y on (£2,#, Q ) are solutions to the (A,y) 
martingale problem. Further, these processes are continuous in probability. By con- 
struction, 7 satisfies 13.1 H and hence by Assumption A6, the finite-dimensional dis- 
tributions of X on (£2, Q ) are the same as those of Y on (£2, & , Q ). This in turn 
implies that the finite-dimensional distributions of X on (£2, J^,P) are the same as 
those of Y on (£2, J?,P). This proves well-posedness of the martingale problem for 

Conversely, let X be a solution of the (A, A) martingale problem that is continuous in 
probability. This time define 
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where C is a constant that is chosen so that (X,g) = 1. Define probability measures 
7 and Q by 



dA=*' and Tdi 



■■g(X ) 



By Lemma 13761 X is a solution to the (A, y) martingale problem under Q and X is 
continuous in Q probability. By the first part, we have that the regular conditional 
probability distribution of (X tl ,X h , . . . ,X tm ) given by <j(Xq) is /ij? (?i,?2> • • • ,t m ). As 
a consequence 

<&pQd*|a(Xo)l = & N ( x o)- (3-12) 



E 

Since d 

El- 
and hence 

Ef 



1 is (J(Xq) measurable, (13. 12t implies that 



3>(X s )ds\o(X ) 



-Wo) 



rN 

/ ®(X s )<k 
Jo 



= E P [<t>* N (X )} 



Since X is a solution to the (A, A) martingale problem, the LHS above is finite for all 
N and hence X e 

(ii) Let X be a solution to the (A, A) martingale problem that is continuous in probability 
(defined on some probability space (i2, J^",P)). Fix m > 1 and < u\ < U2 < ■ ■ ■ < 
u,„ < s and h\,h,2...h m bounded positive continuous functions. Define a probabiltiy 
measure Q on (£2, J?,P) by 

^-=Cft 1 (Z H1 )/z 2 (X H2 )...M^ m ). 
where the constant C is chosen such that Q is a probability measure. Define Y by 

Y t =X s+t , t>0. 
Then using d(Q) /dP which is bounded (say by M), we get 



E : - 



4>(y„)d M 



<ME f 



4>(X i( )dM 



r+.s 



3>(X„)dK 



(3.13) 



Further, it can be shown that Y is a solution to the (A, y) martingale problem where 
y = Q ° [^(O)] -1 - Of course, y is continuous in probability. Hence, by part (i) above 
we get that y G ^<j> and that the finite-dimensional distributions are given by (13. 10l > 
(with X replaced by y). Thus, for g\ ,...,g k £ Cb(E) and < S\ < ■ ■ ■ < s k , 

Eq [gi{Y Sl )... gk {Y Sk )] = J{i4(si,...,s k ),gi®---®g k )dy(x) 

— Eq [{lly (si,...,S k ),gl®---®g k )] 
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and so (using k = 1, s\ = t and gi = g) we can conclude that 



E P [Ch(X ul )h 2 (X U2 ). ..h m (X Um )g(X s+t )} 
= E Q [g(Y t )]=E Q [(Li{(t),g)] 
= E P [Ch i )fc 2 (X„ 2 )...h m (X Um ) (f ) ,g)] 



for all < wi < Ui < • • • < u m < s and hi 1 h2-..h m bounded positive continuous 
functions, m > 1 . As a consequence, 



4. Criterion for an invariant measure 

Several papers gave criterion for a measure to be invariant for the semigroup (T t ) arising 
from a well-posed martingale problem 1 1 2 3 4 6 9 10|. These papers assumed different 
sets of conditions on (A, D (A)). It was shown that existence of solution for each degener- 
ate initial and 



gives existence of a stationary solution of the martingale problem for (A, A). In addition, 
if the martingale problem is well-posed and there is a semigroup (T t ) associated with it, it 
follows that A is an invariant measure for (T,). 

Well-posedness of the martingale problem in the class of r.c.1.1. solutions is sufficient 
for the existence of the semigroup (Tt) (see Theorem 4.4.6 of Q). 

In the light of the results obtained in the previous section, we can improve on this 
criterion for invariant measure. 

We introduce another condition on A and <t> (appearing in Assumption Al). 

Assumption A 7 '. <t> and A/, for every / 6 &(A), are continuous. 

Lemma 4.1. Suppose that A, S> (A) satisfy Assumptions Al, A2, A3 and Al. Then A satis- 
fies the positive maximum principle, i.e. iff £ 2>(A) and z G E are such that f(z) > and 
f{z) > f(x) for all x £ E, then 



Proof. Let X be a solution to (A,8 Z ) martingale problem defined on (£2,J^,P) that is 
continuous in probability. Let = * and 



Then (M t ,JF t ) is a martingale. Let a r , < t < °° be the increasing family of (J£>) stopping 
times defined by 



E P [g(X s+t )\a(X u : 0<u<s)]= «(0^) = {T t g)(X s ). 



This completes the proof. 




Af(z) < 0. 
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Note that a t < t for all t. Since Ep[/q <J>(X„)dM] < °°, it follows that a, increases to °° a.s.. 

LetA^ =M an Y t =X at md% = & at . Then, it follows that (N t ,%) is a local martingale. 
Moreover, t — > <J t is continuous and hence Y is also continuous in probability. Using 
change of variable, it is easy to see that 



; Af(Y r ) 



-*(r r ) 



dr. 



Since Af(x) < Cf<P(x), it follows that AT is bounded and hence is a martingale. Since / 
has a maximum at z and 



dr 



0. 



it follows that (using Fubini's theorem) 
Af(Y r 



f 

Jo 



dr < Vf > 0. 



Since F is continuous in probability and Af(x) < C/4>(x), it follows that 

Af(Y r ) 



(4.1) 



■Ep 



.l + <&(Fr). 

is continuous. Now dividing the LHS in ( 14. 1> by f and taking limit as t — » we get 

l+*(z) " 
Since <t>(z) > this completes the proof. 



Here is yet another assumption onA,i^(A). 

Assumption A8. @{A) is an algebra that contains constants and separates points in E. 

Theorem 4.2. Suppose that A, 3 '(A) satisfy Assumptions Al, A2, A3, A6, A7 ant/ A8. Let 
(T t ) be the semigroup associated with (A, 3(A)) by Theorem Xi.lX 
If X e £?(E) is such that J 4>dA < °o and 

J(Af)(x)dX{x) = Q V/e^(A), (4.2) 

then X is an invariant measure for the semigroup (T t ) and the solution to the (A, A) mar- 
tingale problem that is continuous in probability is a stationary process. 

Proof. In view of Lemma l4~T1 and the assumptions made in the statement of this theorem, 
the proof of Theorem 3.1 in |3| gives the existence of a stationary solution to the (A, A) 
martingale problem. Since the solution (say X) is stationary, the mapping t — ► Jzf (X t ) is 
continuous (it is a constant) and hence by Theorem 12. II X is continuous in probability. 
Now, Theorem l3.7l implies that A is an invariant measure for (Tt). ■ 



Characterisation of Markov processes 
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Remark 4.3. The criterion for invariant measure given above is true even if Assumption 
A7 above is not true but instead one assumes that the operator A satisfies Assumptions A9, 
A10 and Al 1 given below. This is helpful, e.g., when Af is allowed to be a discontinuous 
function (see |4 9 1). 

Assumption A9. A satisfies the positive maximum principle. 

Assumption A 10. There exists a complete separable metric space U, an operator 
A: 9(A) — > C(E x U) and a transition function 77 from (E, 38(E)) into (U,3S(U)) such 
that 

(Af)(x) = [ Af(x,u)rj(x,du). (4.3) 
Ju 

Assumption All. There exists <t> G C(E x U) such that for all / £ 9(A), there exists 
Cf <°° satisfying 

\Af(x, u) I < Cf&(x, u) Vx,u£Ex U, (4.4) 

4>(x) = / 4>(x,w)T7(x,dM) < 00. (4.5) 
if/ 

Under these conditions, existence of a stationary solution to the (A , X ) martingale prob- 
lem was proven in |4 1. Rest of the argument is as in the proof of the above theorem. 



5. Example 

We give two examples of processes that are continuous in probability and which arise as 
solutions of well-posed martingale problems but such that they do not admit any r.c.1.1. 
modification. The results of the previous section, however, are applicable. 

Example 5.1. Let E = [0,1). Let 9(A) be the class of functions / that are restrictions 
of some periodic function g £ C?(M) with period 1. Further for / £ Si (A) define Af by 
Af = \f". Then A and 9(A) satisfy the 
conditions of Theorems l3.2l and l3.7l 

It follows easily that if W is a one-dimensional standard Brownian motion then X t = W t 
(mod 1) is a solution to the martingale problem for A. Moreover, for any other solution Y 
of the martingale problem, it is easy to check that Y behaves like a Brownian motion as 
long as it does not hit the boundary. Now, uniqueness can be shown using localisation 
arguments as in Theorem 6.6.1 of 1131 . 

Note that almost every path of the unique solution X is neither r.c.1.1. nor l.c.r.l. However 
the set of discontinuity points of X is contained in the set 

{t: W t is an integer}. 

This implies that X is continuous in probability. 

Example 5.2. Let E — (Q,°°) and let fi be a probability measure on E with jj.{(Q,a)} = 
for some a > 0. Let 2#(A) be defined by 

9(A) = lf£ C z b (E): lim/M =//d/i 
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For / e 2i(A) define Af by Af = \f". Once again, A and 2(A) satisfy the conditions of 
Theorems l3.2l and l3.7l 

The uniqueness of solution for the martingale problem for A can also be shown using 
localisation arguments as in Theorem 6.6.1 of 1131 . To construct the unique solution for 
the (A, 8 X ) martingale problem we can proceed as follows. 

Let {W z l : i > 0} be independent one-dimensional standard Brownian motions starting 
at z. Define 

T J = inf{f > 0: W z '' =0}. 

Note that 

T z,! < °° a.s. for every z,i. (5.1) 

Let U\, U2, ■ ■ ■ be i.i.d. random variables with common distribution ji and which are inde- 
pendent of all {W zJ : 2 > 1}. Define 

(w?'°, forf<T x0 , 

\w t U, i , for T^-i' 1 '- 1 < t < T U ' A ; i > 1. 

Then it is easily checked that X x is a solution of the martingale problem for A starting at 
x and which is also continuous in probability. Then \5.l\ and the fact that ^ E together 
imply that almost every path of X x is not left continuous. 
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